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TITLE OF THE INVENTION 

IMAGE FORMING APPARATUS AND METHOD FOR OPERATING IMAGE 
FORMING APPARATUS BY USING REMOTE APPLICATION 

5 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to techniques for operating an image forming apparatus 
by using a fev aTAVA application. 

10 

2. Description of the Related Art 

Recently, an image forming apparatus (to be referred to as a compound machine 
hereinafter) that includes functions of a printer, a copier, a facsimile, a scanner and the like in 
a cabinet is generally known. The compound machine includes a display part, a printing part 

1 5 and an image pickup part and the like in a cabinet. In the compound machine, pieces of 

software corresponding to the printer, copier and facsimile respectively are provided, so that 
the compound machine functions as the printer, the copier, the scanner and the facsimile 
respectively by switching the pieces of software. 

Since the conventional compound machine is provided with respective pieces of 

20 application software for the printer, the copier, the scanner and the facsimile, much time is 

required for developing each application. To solve this problem, the applicant has developed 
a compound machine including hardware resources, a plurality of applications, and a 
platform including various control services provided between the applications and the 
hardware resources. The hardware resources are used for image forming processes for a 

25 display part, a printing part and an image pickup part. The applications perform processes 
intrinsic for user services of printer, copier and facsimile and the like. The platform includes 
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various control services for performing management of hardware resources necessary for at 
least two applications commonly, and for performing execution control of the applications 
and image forming processes, when a user service is executed. 

According to such a new compound machine, the applications and the control services 
5 are provided separately. Thus, after the compound machine is shipped, users or third party 
venders can develop new applications to install on the compound machine without changing 
the system side software. 

Various applications are developed. For developing the applications, from a 
viewpoint of supporting various platforms and network communications, it is considered to 
1 0 use Java JAVA applications as applications for the compound machine. As a conventional 
technology relating to the Jav aJAVA application, a technology described in Japanese laid 
open patent application No. 2002-287990 is known, for example. 

For executing the Java JAVA applications on the compound machine, a module is 
necessary for managing the Java JAVA. applications. In addition, for developing the 
1 5 Java JAVA application for the compound machine, it is necessary to evaluate the developed 
application whether the application actually operates on the compound machine after the 
Jav aJAVA application is developed on a PC and the like. However, it is troublesome to 
install and execute the Java JAVA application on the compound machine every time when the 
evaluation is performed. Thus, an environment is required in which the developed 
20 application can be directly executed on the compound machine from the PC on which the 
application is developed. In addition, if remotely executed Java J A VA application can 
operate the compound machine, user convenience increases for using the Java JAVA 
application. 

25 SUMMARY OF THE INVENTION 
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An object of the present invention is to provide an environment in which the 
Java JAVA application can be easily executed in the compound machine and to provide an 
environment in which the compound machine can be operated by a Jav aJAVA application 
that is executed on a terminal apparatus such as the PC. 
5 The above object is achieved by an image forming apparatus that includes a control 

part that provides common services on control of hardware resources to a plurality of 
applications so as to be able to include a plurality of applications, the image forming 
apparatus including: 

a virtual machine; 

10 an application that is executed by the virtual machine; and 

an application management part managing the application that is executed by the 
virtual machine. 

According to the present invention, since the virtual machine is provided on the 
application layer of the image forming apparatus, the Java JAVA application that can be 
1 5 executed by the virtual machine can be executed. In addition, since the application 

management part is provided, it is easy to add, delete, and manage Java JAVA applications. 
Thus, the Java JAVA application can be easily executed on the image forming apparatus. 

In the image forming apparatus, the application that is executed by the virtual 
machine can operate the image forming apparatus by using classes for controlling the image 
20 forming apparatus. The classes include an operation panel class for outputting information to 
an operation panel of the image forming apparatus and for inputting information from the 
operation panel. By using the classes, the Java JAVA application can be easily developed. 

In the image forming apparatus, the application management part includes execution 
management functions that include a function for launching the application executed by the 



3 



Application No. 10/807,323 

Marked-Up Copy of Substitute Specification 

virtual machine. In addition, the application management part downloads the application 
when the application is not installed in the image forming apparatus. 

The application management part refers to an application information file associated 
with the application, and updates the application on the basis of information in the application 
5 information file. Since the application can be updated on the basis of the setting of the 
application information file, the application can be automatically updated. 

The application management part can compare a first version described in the 
application information file associated with the application with a second version described in 
another application information file associated with an update application, and the application 

1 0 management part replaces the application with the update application if the second version is 
newer than the first version. Thus, an old application can be automatically updated. 

The application management part may download the application from a memory card 
or from a Web site. In addition, the application management part may download the 
application from a location described in the application information file associated with the 

1 5 application. The application management part can check whether the application is 

executable in the image forming apparatus before downloading the application, and the 
application management part can check whether the application is executable on the basis of 
information described in the application information file associated with the application. In 
addition, the application management part can check items including a resource item in the 

20 image forming apparatus necessary for executing the application. Therefore, the application 
can be safely installed and updated. 

The image forming apparatus may include a server application that receives an 
operation request from a terminal apparatus connected to the image forming apparatus and 
that operates the image forming apparatus according to the operation request. According to 

25 the present invention, the image forming apparatus can be operated by the application 



4 



Application No. 10/807.323 

Marked-Up Copy of Substitute Specification 

executed in the terminal apparatus. The application management part communicates with the 
terminal apparatus. 

In addition, the above-mentioned object is achieved by a terminal apparatus that 
operates an image forming apparatus configured to be able to include a plurality of 
5 applications, the terminal apparatus including: 
a virtual machine; 

an application that is executed by the virtual machine and that operates the image 
forming apparatus; and 

an application management part managing the application that is executed by the 
1 0 virtual machine. 

According to the present invention, the image forming apparatus can be operated by 
the application executed in the terminal apparatus. 

The terminal apparatus is connected to the image forming apparatus via a network, 
and the application that is executed by the virtual machine operates the image forming 
1 5 apparatus by using classes for controlling the image forming apparatus. In addition, the 
terminal apparatus can operate the image forming apparatus by using a fevaJAVA based 
distributed object processing technique. By using the fev aJAVA based distributed object 
processing technique that supports processing via a network, the image forming apparatus 
can be operated by an application executed in an apparatus on a network. 
20 In the terminal apparatus, the classes may include a function for displaying, on the 

terminal apparatus, an emulated screen of a screen displayed on an operation panel of the 
image forming apparatus. Thus, the user can operate the image forming apparatus from the 
terminal apparatus as if to operate the image forming apparatus directly. 

The terminal apparatus may have a function for allowing a user to select whether to 
25 access a hard disk of the image forming apparatus or to access a hard disk of the terminal 
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apparatus. For example, the user can select a file stored in the hard disk of the image forming 
apparatus from the terminal apparatus. 

In the terminal apparatus, the application management part may include execution 
management functions that include a function for launching the application, and may 
5 download the application when the application is not installed in the terminal apparatus by 
communicating with the image forming apparatus. In addition, the application management 
part can refer to an application information file associated with the application, and update 
the application on the basis of information in the application information file. 

The application management part can download the application from a memory card 
1 0 that is inserted in the image forming apparatus or from a Web site. In addition, the 

application management part can receive file information stored in the memory card and 
displays the file information on the terminal apparatus. 

The application management part can send URL information input into the terminal 
apparatus to the image forming apparatus, so that the image forming apparatus downloads the 
1 5 application from the Web site by using the URL information. Since the application 

management part communicates with the image forming apparatus for performing processes, 
the management function for applications in the image forming apparatus can be extended to 
the terminal apparatus. 



20 BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects, features and advantages of the present invention will become more 

apparent from the following detailed description when read in conjunction with the 

accompanying drawings, in which: 

Fig.l is a block diagram of a compound machine 100 according to an embodiment of 
25 the present invention; 

Fig.2 shows an example of a hardware configuration of the compound machine 100; 
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Fig. 3 shows a configuration example of a Jav aJAVA execution environment 116 

according to a first embodiment; 

Figs.4A and 4B show implementation examples of an application management part 

204; 

Fig. 5 shows an example of a hierarchy structure of the operation panel used by the 
Java JAVA application; 

Fig.6 shows a program list of the JavaJAVA application; 
Fig.7 is a screen displayed by the simple printer; 

Fig. 8 is an example of a soft keyboard displayed by executing the simple printer; 
Fig. 9 is a flowchart showing a procedure for launching the simple printer according to 
the first embodiment; 

Fig. 10 shows an example of a syntax of a JNLP file; 
Fig.l 1 shows a tree structure of the JNLP file; 

Fig. 12 is a flowchart for automatically updating a Java JAVA application (update 
target application) in an SD card (which is an example of a memory card) or in a HDD with a 
Java JAVA application (update application) from a SD card; 

Fig. 13 is a flowchart for automatically updating a Java JAVA application (update 
target application) in the SD card or in the HDD with a Java J AVA application (update 
application) from a Web server; 

Fig. 14 shows a system configuration according to a third embodiment of the present 
invention; 

Fig. 1 5 is a flowchart showing a procedure for launching the simple printer according 
to the third embodiment; 

Fig. 1 6 is a block diagram of the compound machine according to a fourth 
embodiment of the present invention; 
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Fig. 17 shows classes of the JSDK application 147 and the JSDK platform 148 in 

Fig. 16; 

Fig. 18 shows a system configuration according to the fourth embodiment; 
Fig. 19 shows classes of the JSDK application 147 and the JSDK platform 148 in the 
5 PC 701 in Fig. 18; 

Fig.20 is a figure for explaining execution procedure of preparation processes for 
remote operation in the compound machine 100. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
1 0 In the following, embodiments of the present invention are described with reference 

to figures. In the following, a JavaTAVA execution environment in the compound machine is 

described as first and second embodiments. Next, an environment in which the compound 

machine is operated by executing an application, developed in a PC and the like, in the PC is 

described as third and fourth embodiments. First, the compound machine used in the first to 

1 5 third embodiments is described. 

Fig.l is a block diagram of a compound machine 100 according to an embodiment of 
the present invention. 

As shown in Fig.l, the compound machine 100 includes hardware resources 103 and 
a software group 110. The hardware resources 103 include a black and white laser printer 

20 (B&W LP) 101, a color laser printer 102, and hardware resources such as a scanner, a 
facsimile, a hard disk, memory (RAM, NV-RAM, ROM and the like) and a network 
interface. The software group 110 includes a platform 120, and applications 130. 

The platform 120 includes control services for interpreting a process request from an 
application to issue an acquiring request for the hardware resources, a system resource 

25 manager (SRM) 123 for managing one or more hardware resources and arbitrating the 
acquiring requests from the control services, and a general -purpose OS 121 . 
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The control services include a plurality of service modules, which are a system 
control service (SCS) 122, an engine control service (ECS) 124, a memory control service 
(MCS) 125, an operation panel control service (OCS) 126, a fax control service (FCS) 127, 
and a network control service (NCS) 128. The platform 120 has application program 
5 interfaces (API) that can receive process requests from the applications 130 by using 
predetermined functions. 

The general purpose OS 121 is a general purpose operating system such as UNIX, and 
can execute each piece of software of the platform 120 and the applications 130 concurrently 
as respective processes. 

10 The process of the SRM 123 is for performing control of the system and performing 

management of resources with the SCS 122. The process of the SRM 123 performs 
arbitration and execution control for requests from the upper layer that uses hardware 
resources including engines such as the scanner part and the printer part, a memory, a HDD 
file, and a host I/Os (Centronics I/F, network I/F IEEE1394 I/F, RS232C I/F and the like). 

15 The process of the SCS 122 performs application management, control of the 

operation panel, display of system screen, LED display, resource management, and interrupt 
application control. The process of the ECS 124 controls engines of hardware resources 
including the white and black laser printer (B&W LP) 101, the color laser printer (Color LP) 
102, the scanner, and the facsimile and the like. 

20 The process of the MCS 125 obtains and releases an area of the image memory, uses 

the hard disk apparatus (HDD), and compresses and expands image data. The process of the 
FCS 127 provides APIs for sending and receiving facsimile by using PSTN/ISDN network 
from each application layer, registering/referring of various kinds of facsimile data managed 
by BKM (backup SRAM), facsimile reading, facsimile receiving and printing, and mixed 

25 sending and receiving. 
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The NCS 128 is a process for providing services commonly used for applications that 

need network I/O. The NCS 128 distributes data received from the network to a 

corresponding application, and acts as mediation between the application and the network 

when sending data to the network. More specifically, the process of the NCS 128 includes 

5 server daemon such as ftpd, httpd, lpd, snmpd, telnetd, smtpd, and client function of the 

protocols. 

The process of the OCS 126 controls an operation panel that is a means for 
transferring information between the operator (user) and control parts of the machine. In the 
compound machine 100 of the embodiment, the OCS 126 includes an OCS process part and 

1 0 an OCS function library part. The OCS process part obtains an key event, which indicates 
that the key is pushed, from the operation panel, and sends a key event function 
corresponding to the key event to the SCS 122. The OCS function library registers drawing 
functions and other functions for controlling the operation panel, in which the drawing 
functions are used for outputting various images on the operation panel on the basis of a 

1 5 request from an application that has control right or from a control service. When the 

application is developed, functions in the OCS function library is linked to an object program 
that is generated by compiling a source code file of the application, so that an executable file 
of the application is generated. 

The applications 130 include a printer application 1 1 1 that is an application for a 

20 printer having page description language (PDL) and PCL and post script (PS), a copy 
application 1 12, a fax application 113 that is an application for facsimile, a scanner 
application 1 14 that is an application for a scanner, and a network file application 115. In 
addition, a Java JAVA execution environment 116 and a Java JAVA application 1 17 are 
included. The compound machine 100 shown in Fig.l includes a plurality of Java JAVA 

25 applications. 
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Interprocess communication is performed between a process of the application and a 

process of the control service, in which a function is called, a returned value is sent, and a 

message is sent and received. By using the interprocess communication, user services for 

image forming processes such as copying, printing, scanning, and sending facsimile are 

realized. 

As mentioned above, the compound machine 100 of this embodiment includes a 
plurality of applications 130 and a plurality of control services, and each of those operates as 
processes. In each process, one or more threads are generated and the threads are executed in 
parallel. The control services provide common services to the applications 130. User 
services on image formation such as copying, printing, scanning and sending facsimile are 
provided while the processes are executed in parallel, the threads are executed in parallel, and 
interprocess communication is performed. A third party vendor can develop new 
applications for the compound machine 1 00, and can execute the applications in the 
application layer on the control service layer in the compound machine 100. 

Fig.2 shows an example of a hardware configuration of the compound machine 100. 

As shown in Fig.2, the compound machine 100 includes a controller 40, an operation 
panel 60, a fax control unit (FCU) 65, and an engine 70 and a plotter 75. 

The controller 40 includes a CPU 41, a MEM-P (system memory) 42, a north bridge 
(NB) 43, a south bridge (SB) 44, an ASIC 45, a MEM-C (local memory) 46, an HDD 47, a 
network interface card (NIC) 48, a USB device 49, an IEEE1394 device 50, and a Centronics 
51. 

The operation panel 60 is connected to the ASIC 45 of the controller 40 directly. The 
FCU 65, interfaces, the engine 70 and the plotter 75 are connected to the ASIC 45 in the 
controller 40 via a PCI bus. 
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The CPU 41 controls the compound machine 100. The NB 43 is a bridge for 

connecting the CPU 41, the MEM-P 42 and the ASIC 45. The MEM-P 42 is a system 

memory used as a drawing memory for example. The SB 44 is a bridge for connecting the 

NB 43 and peripheral devices. In this embodiment, a memory card slot 441 is provided in 

5 which a memory card 442 can be inserted. The MEM-C 46 is a local memory used as a copy 

image buffer, a code buffer and the like. The ASIC 45 is an IC for image processing 

including hardware for image processing. The HDD 47 is a storage for storing image data, 

programs, font data and the like. 

10 (First embodiment) 

Next, the execution environment 1 16 of the Java JA VA application 1 17 in the 
compound machine 100 is described as the first embodiment. 

Fig. 3 shows a configuration example of the tevaJAVA execution environment 116 
according to the first embodiment. As shown in Fig. 3, the feva JAVA execution environment 
15 116 includes a compound machine class library 201 , a virtual machine 202, a native program 
interface 203 and an application management part 204. 

The compound machine class library 201 is a class library used for the feva JAVA 
application 1 17 to easily operate the compound machine 100, so that the Java JAVA 
application 117 can access APIs of the compound machine 100 by using the mechanism of 
20 the native program interface 203. By the compound machine class library 201 , machine- 
dependent functions can be identified, simple operation functions are provided, and various 
object oriented classes can be provided. 

The compound machine class library 201 according to this embodiment includes a 
basic J-av aJA VA class library, event classes for processing events, network transaction 
25 classes for performing processes for network communications, operation panel classes for 

12 
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drawing images on the operation panel of the compound machine 1 00, compound machine 
control classes for controlling the compound machine 1 00 and the like. The operation panel 
class and the compound machine control class are classes specific for the compound machine 
100 of this embodiment. The operation panel class and the compound machine control class 
may be referred to as "compound machine class" hereinafter, and other classes (the basic 
Java JAVA class library, event classes, network transaction classes) may be referred to as 
"Java JAVA core class". 

A Jav aJAVA source code program is compiled into intermediate code (byte code). 
The virtual machine 202 has functions for interpreting and executing the byte code. The 
native program interface 203 has functions for the Jav aJAVA code executed by the virtual 
machine 202 to be interoperable with applications and libraries written by a different 
programming language such as the C language. 

The application management part 204 has functions for managing the Java JAVA 
applications. For example, the application management part 204 has functions for displaying 
a list of Java JAVA applications, installing and updating the Java JAVA applications, deleting 
installed Java JAVA applications, setting a password for registering applications, storing 
Java J AVA applications and the like. In addition, the application management part 204 
performs Java JAVA application execution management such as launch, forced termination, 
suspend, and resume for the JavaJAVA application. 

The application management part 204 is implemented in the compound machine 100 
as a component independent from the virtual machine 202, so that the application 
management part 204 cannot be controlled from the Jav aJAVA application 117. As shown in 
Figs.4A and 4B, the application management part 204 can be implemented as a Java JAVA 
application (Fig.4A), or can be implemented as a C language program (Fig.4B) or the like. 
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Since the feva JAVA execution environment 1 16 is an application mounted on the 

compound machine 100, the feva JAVA execution environment 116 can be installed into the 

compound machine 100 in the same way as other applications. For example, the fev aJAVA 

execution environment 116 can be installed into the compound machine 100 from a memory 

5 card. 



(Example of J-av aJAVA application) 

Next, an example of the Java JAVA application is described. In the following 
example, a Java JAVA application that uses the operation panel class is described. Fig. 5 

1 0 shows an example of a hierarchy structure of the operation panel class used by the Java J AV A 
application. Fig.6 shows a program list of the feva JAVA application. In the following, the 
application program may be referred to as "simple printer". 

Next, the program shown in Fig.6 is described. This program causes the compound 
machine 1 00 to display a user interface screen on the operation panel of the compound 

1 5 machine 100, receive a specified print file name from the operation panel, and print the 
specified file. The outline of the operation of the program is as follows. 

Right after the compound machine 100 is launched, a screen shown in Fig.7 is 
displayed on the operation panel. As shown in Fig.7, a character string "Simple Printer" is 
displayed on the upper part of the screen, and a button of "Get input filename..." is displayed 

20 on the center part of the screen. When the user touches the button of "Get input filename...", 
a software keyboard shown in Fig. 8 as an example is shown on the operation panel. On the 
software keyboard, a title : "Input file name" is displayed, so that the user inputs a name of 
a file that the user wants to print. For example, when the user inputs "/usr/hdd/photo.tiff the 
program causes the compound machine 100 to print the "photo.tiff file that is stored in a 

25 directory : "/usr/hdd". 
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In the following, the program is described according to the numbers of annotations of 

the program. 

"(1)" is a command for using the compound machine class library. "(2)" indicates 
that GWApp is inherited, in which GWApp is a prototype (abstraction) of the application of 
5 the compound machine on initial setting and end processing. Accordingly, the user does not 
need to write complicated initial setting code and end processing code, and processes for 
receiving a message and the like can be hidden from the user. 

By "(3)", an object for operating a printer is created, and an object for displaying a 
message : "Simple Printer" is created by "(4)", and a button object for "Get input filename..." 
10 is created by "(5)". "(6)" indicates to add an object such that a software keyboard is 

displayed at the time when the user touches the button. "(7)" indicate to display the software 
keyboard and prompt the fine name. The file specified by the software keyboard is printed 
by "(8)". 

In the button operation ((5) "Get input filename..."), the result of the button operation 
1 5 is received by the program as a message, and the program performs a process corresponding 
to the button operation in response to receiving the message. The process is set in 
addChangeListener() of (6). 

(Example of procedure from download to launch) 
20 Installing and launching of the J-ava JAVA application is managed by the application 

management part 204. Thus, by using the functions of the application management part 204, 
processes from download to launch can be performed in the following way. The procedure is 
described taking a case for launching the simple printer as an example with reference to a 
flowchart shown in Fig.9. 

15 
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The application management part 204 is launched when the compound machine 100 is 

launched like other applications. By pushing an application selection key corresponding to 

the application management part 204, a user interface screen for operating the application 

management part 204 is displayed on the operation panel of the compound machine 100 in 

5 step S 1 . When the user identifies, on the user interface screen, that the simple printer is 

installed as a JevaJAVA application, the user selects the simple printer to execute it in step 

S2. 

If the simple printer is not installed, an application load screen is displayed by 
specifying load of application from the user interface screen in step S3. 

10 On the application load screen, the user selects whether to download the simple 

printer from a Web site or to download it from a memory card inserted into the compound 
machine in step S4. 

In the case when the simple printer is downloaded from the memory card, the 
application management part 204 checks files in the memory card, and displays file names 

1 5 stored in the memory card on the operation panel in step S5. When the user selects the 

simple printer in step S6, the application management part 204 checks if the application can 
be executed on the compound machine 100 in step S7. According to the result of the check, 
if the application can be executed, the application is downloaded and installed into the hard 
disk. In addition, the application management part 204 obtains the application name (simple 

20 printer) and add it to an application list in step S9, in which the application list is a file 
managed by the application management part 204 for the user to recognize installed 
Java JAVA applications. 

In the case when the simple printer is downloaded from the Web server, Web is 
selected in the step S4, so that a screen for specifying a URL is displayed from which screen 

25 the user inputs a URL of a Web site having the simple printer program in step S 1 0. Then, the 
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application management part 204 accesses the Web site in step SI 1, and checks if the simple 
printer can be executed on the compound machine in step SI 2, and downloads the simple 
printer in step SI 3. Then, the application management part 204 installs the simple printer 
into the hard disk, obtains the application name (simple printer) and adds the name to the 
5 application list in step S14. 

Alternatively, the application management part 204 may automatically searches for 
the memory card or the Web server to install the application into the hard disk. In the above- 
mentioned example, although an example in which the teva JAVA application is installed into 
the hard disk is described, the Java JAVA application is not necessarily installed into the hard 
1 0 disk to execute the fov aJAVA application. 

For checking if the teva JAVA application can be executed in the compound machine 
100, the application management part 204 checks program size, version of the program, 
program latest update information, use memory work size, use storage size, use network 
address, the term of validity (usable number), application program name and the like. These 
1 5 items of information are associated with the jktva JAVA application. As described later, the 
items of information may be obtained from a JNLP file corresponding to the ^avaJAVA 
application. 

After the above-mentioned processes ends, the downloaded simple printer can be 
used, so that the user launches the simple printer from the user interface screen in step SI 5. 
20 Accordingly, the virtual machine 202 is launched and the simple printer is executed. 

The launched simple printer operates the compound machine 1 00 by using the 
Java JAVA core class and the compound machine class so as to display the before-mentioned 
user interface screen for the simple printer. The user inputs a name of a file that the user 
wants to print, so that the file is printed. In this example, 'Vusr/hdd/photo.tiff ' is input, and a 
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"photo.tiff ' file that is stored in a "/usr/hdd" directory in the hard disk in the compound 
machine 100 is printed. 

After the printing ends, the application management part 204 terminates execution of 
the simple printer. 

5 

(Second embodiment) 

The compound machine 100 can automatically update a J&vaJAVA application that is 
installed in the compound machine 100 by using JNLP (JavaJAVA Networking Language 
Protocol). In the following, automatic update of the Jw aJAVA application by using JNLP is 
10 described. Following processes are controlled by the application management part 204. 

Since "JNLP file" (to be also referred to as "application information file") is used in 
the following processes, a description is given first for the JNLP file. The JNLP file is in a 
one-to-one correspondence with a Java JAVA application, and includes information on 
definitions of the Java JAVA application. That is, a JNLP file is attached to each Java JAVA 
1 5 application. 

Fig. 10 shows an example of a syntax of the JNLP file. The JNLP file is a 
XML(eXtensible Markup Language) file. The format of the JNLP file is in conformity with 
JNLP standard. However, the JNLP used in this embodiment is extended. Following is the 
extension. 

20 In Fig. 1 0, the description 1 is an information element which includes a title element 

(description 1 A) indicating an application name, a vender element (description IB) indicating 
a vender name, a telephone element (description 1C) indicating a telephone number of the 
vender, a fax element (description ID) indicating a fax number of the vender, and a product 
ID element (description IE) indicating a product ID of the application. 
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The description 2 indicates a security element. The description 3 indicates a resource 

element which includes a jsdk element (description 3 A) indicating a version of a JavaJAVA 

application, ajar element (description 3B) indicating a Jar file (execution file of the 

Java JAVA application) and the version, and a sub-jnlp element (description 3C) indicating a 

SUB-JNLP file. 

The description 4 is an update element which is an element for setting an execution 
method of update. If the element is "auto", update of the application is automatically 
performed. If the element is "manual", update of the application is performed manually. If 
the element is "mail", an update notification mail is delivered when update of the application 
can be performed. 

The description 5 indicates an install element which indicates an execution method for 
install. If the element is "auto", an install destination of the application is automatically 
selected. If the element is "manual", the install destination of the application is manually 
selected. The description 6 indicates whether the type of the application is "GUI present" or 
"GUI absent". 

Information of the JNLP file corresponding to the Jav aJAVA application generally 
has a tree structure as shown in Fig. 1 1 . A JNLP file referred to from an upper JNLP file 
corresponds to a module that is used in execution of a Java JAVA program corresponding to 
the upper JNLP file. 

As described in the update element of Fig. 10, an installed JavaJAVA application is a 
target of update. In the following, automatic update for automatically updating the installed 
Java J AVA application is described. 

Fig. 12 is a flowchart for automatically updating a Java J AVA application (update 
target application) in an SD card (which is an example of a memory card) or in a HDD to a 
JavaJAVA application (update application) from a SD card. 
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When a SD card including the update application is set in a SD card slot, the 

application management part 204 obtains a JNLP file of the update application in the SD card 

in step SI 01 . When the update element of the JNLP file is "auto" and when the compound 

machine 100 includes an update target application same as the update application 

5 corresponding to the JNLP file (steps SI 02, SI 03), the application management part 204 

compares versions of the update application and the update target application in step SI 04. 

When the version of the update application is newer than the version of the update target 

application (step SI 05), the application management part 204 updates the update target 

application to the update application in step SI 06 (replaces the update target application with 

10 the update application). That is, the application management part 204 updates the Jar file and 

the JNLP file. 

Fig. 13 is a flowchart for automatically updating a Java JAVA application (update 
target application) in the SD card or in the HDD with a Java JAVA application (update 
application) from a Web server. 

1 5 The application management part 204 obtains a JNLP file of the update target 

application in step S201 . When the update element of the JNLP file is "auto" and when the 
Web server that is connected to the compound machine 1 00 includes an update application 
same as the update target application (step S202, S203), the application management part 204 
compares versions of the update target application and the update application in step S204. 

20 When the version of the update application is newer than the version of the update target 

application, the application management part 204 updates the update target application with 
the update application in step S206. 

The destination that the compound machine 100 accesses for accessing the update 
application can be obtained by referring to the JNLP file. When the JNLP file is the tree 

25 structure, the above-mentioned process is performed for JNLP files of each layer. 
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The trigger for starting the update may be an elapsed time from power on of the 

compound machine 100, a predetermined time, power ON/OFF of the compound machine 

100, before running/while running/after running application, an elapsed time while idling, 

and the like. 

5 Also in the first embodiment, the JNLP file can be used. In such a case, before 

downloading the Java JAVA application, the compound machine 100 can check if the 
Java JAVA application is executable according to information in the JNLP file. In this case, 
the JNLP file includes information used for determining whether the Java JAVA application is 
executable in the compound machine 100. For example, the JNLP file includes information 

10 for authentication, device configurations (color supported, for example) necessary for 

executing the Jkm JAVA application, use resource information and the like in addition to the 
program size and the like described in the first embodiment. The information in the JNLP 
file are compared with resource information and the like in the compound machine 100. As a 
result, if the compound machine 100 determines that the Jav aJAVA application is not 

1 5 executable, a warning is output, for example. In addition, the Jar file may include a digital 
signature for authentication, so that the application management part 204 may verify the 
signature. 

(Third embodiment) 

20 Next, a method is described in which the compound machine 100 is operated remotely 

by executing a Java JAVA application in a PC which may be used for developing the 
JavaJAVA application. 

Fig. 14 shows a system configuration for executing the Jav aJAVA application 
according to this embodiment. As shown in the figure, the system includes a PC 300 and a 
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compound machine 100 that are connected via a network 400. The PC 300 is a PC used for 
developing a fava JAVA application for the compound machine 1 00, for example. 

The PC 300 includes a simple printer 301 that is a Jav aJAVA application, a 
fevaJAVA core class 304, a client compound machine class 303 for operating the compound 
5 machine class in the compound machine 100, a remote application management part 302 for 
managing applications by communicating with the application management part 204 of the 
compound machine 100, a virtual machine 305 and a OS 306. 

The compound machine 100 includes a server compound machine application 210 in 
addition to the J-ava JAVA execution environment 116. The server compound machine 
10 application 210 is an application executed in the compound machine 100 for providing 
remote operation service from the PC 300. The native program interface is not shown in 
Fig. 14. 

The client compound machine class 303 in the PC 300 communicates with the server 
compound machine application 210, so that the client compound machine class 303 operates 
15 objects in the compound machine 100. Accordingly, the compound machine 100 can be 
operated remotely from the PC 300, and distributed processing of applications can be 
realized. The technique for operating objects in the compound machine 100 from the remote 
PC 300 can be realized by using Jav aJAVA based distributed object processing technology, 
for example. 

20 The remote application management part 302 communicates with the application 

management part 204 of the compound machine 100 so that the feva JAVA application 
management function for the compound machine 100 can be extended to the PC 300. The 
remote application management part 302 includes functions same as those of the application 
management part 204 of the compound machine 100. That is, the remote application 

25 management part 302 includes functions for the fava JAVA application execution 
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management (launch / forced termination / suspend / resume and the like), install and update 
of the feva JAVA application, delete of installed Java JAVA application, password setting for 
application registration, storing Jav aJAVA application, display list of installed Java JAVA 
applications and the like. The above-mentioned processes are performed by communicating 
5 with the application management part 204 of the compound machine 1 00 as necessary. 

The client compound machine class 303 in the PC 300 also includes a function for 
emulating a part of functions of the compound machine 100. For example, the client 
compound machine class 303 can emulate operations of the operation panel of the compound 
machine 100. 

1 0 For operating the compound machine 1 00 by using an application executed in the PC 

300, it can be selected whether to use the operation panel of the compound machine 100 or to 
use the emulation function in the PC 300. In the case where the operation of the operation 
panel is emulated, the screen to be displayed on the operation panel of the compound 
machine 100 is displayed on the PC 300. The keyboard and the mouse of the PC 300 are 

1 5 used for operating the operation buttons displayed on the PC 300. The selection between 
using the operation panel of the compound machine 1 00 and using the keyboard and the 
mouse of the PC 300 is performed by sending a request from the remote application 
management part 302 to the application management part 204 of the compound machine 100. 
For example, when the remote application management part 302 notifies the application 

20 management part 204 in the compound machine 100 that the PC 300 emulates the operation 
panel, the application management part 204 controls the compound machine 100 such that 
screen display information generated by operating the compound machine 100 is sent to the 
PC 300 instead of displaying on the compound machine 100. 

When executing the Java JAVA application from the PC 300, as to same kind of 

25 resources in the remote PC 300 and the compound machine 100, the user can select one 
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between the remote PC 300 and the compound machine 100. For example, as to "hard disk" 
that is included in both of the PC 300 and the compound machine 100, the user can select 
whether using a hard disk of the PC 300 or a hard disk of the compound machine 100 from 
the PC 300. Other such resources are resources for networking, I/0(USB, ilink, RS 232C) 
5 and the like. 

Next, in the environment indicating Fig. 14, a procedure for operating the compound 
machine 100 by executing a J-avaJAVA application in the PC 300 is described with reference 
to a flowchart of Fig. 15. In the following example, the simple printer is used as an example. 
First, the remote application management part 302 is launched in the PC 300. In the 
10 compound machine 100, the Java JAVA execution environment 1 16 including the application 
management part 204, and the server compound machine application 210 are already 
executed. 

The remote application management part 302 displays a screen for selecting an 
application on the PC 300 in step S21 . At this time, it is checked whether the feva JAVA 

1 5 application is installed in the hard disk in the compound machine 1 00 or in the hard disk in 
the PC 300. In the check of the fava JAVA application, for example, the remote application 
management part 302 checks the fev aJAVA application in the PC 300, and the application 
management part 204 in the compound machine 100 checks the feva JAVA application in the 
compound machine 1 00 and the application management part 204 notifies the remote 

20 application management part 302 of the check result. When the Java JAVA application 

exists, the feva JAVA application name is displayed on the screen. When the user selects the 
simple printer, the simple printer is launched in step S22. 

As a result of the check whether the Jav aJ AVA application is installed, if the 
feva JAVA application is not installed in either of the hard disks, an application load screen is 

25 displayed by specifying application load from the screen in step S23. 
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The user selects, from the application load screen, whether to download the simple 

printer from a Web site or from a memory card inserted in the compound machine 1 00 in step 

S24. 

When the user select to install the feva JAVA application from the memory card, the 
5 application management part 204 recognizes the memory card when the memory card is 
inserted into the compound machine 100, and the application management part 204 checks 
file information in the memory card, and notifies the remote application management part 
302 of the file information in step S25. 

The remote application management part 302 displays the notified file information on 
1 0 the screen of the PC 300 in step S26, so that the user selects the simple printer in step S27. 
Then, the remote application management part 302 notifies the application management pat 
204 that the simple printer is a target for downloading. The application management part 204 
sends information on the application (simple printer) to the remote application management 
part 302. The remote application management part 302 checks whether the simple printer is 
15 executable in the environment of the system in step S28. If the remote application 

management part 302 determines that the simple printer is executable, the remote application 
management part 302 instructs the application management part 204 to download the simple 
printer, so that the simple printer is downloaded in step S29 and installed into an install 
destination (hard disk of the PC 300 or the hard disk of the compound machine 100) that is 
20 already specified in step S30. In addition, the simple printer is added to the application list. 

The check items in the step S28 are, for example, program size, version, program 
latest update information, use memory work size, use storage size, use network address, the 
term of validity (usable number), application program name and the like. 

In the case when the simple printer is installed from a Web sit, the remote application 
25 management part 302 displays a screen for allowing the user to specify a URL of the Web 
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server, so that the user inputs the URL from the screen in step S3 1 . Then, the remote 
application management part 302 notifies the application management part 204 in the 
compound machine 100 of the URL in step S3 2. Then, the application management part 204 
accesses the Web site of the URL in step S33, and checks whether the application (simple 
5 printer) in the Web site can operate the compound machine 100 from the PC 300 in step S34. 
This check can be also performed by the remote application management part 302. In this 
case, the application management part 204 obtains predetermined information (JNLP file for 
example) and send the information to the remote application management part 302. 

When it is determined that the application can operate the compound machine 100, 
10 the simple printer is downloaded in step S35, and installed in a specified hard disk. Then, the 
simple printer is added to the application list in step S36. 

When the simple printer is installed, the simple printer can be selected from a screen 
of step S21 . When the simple printer is selected, the remote application management part 
302 loads the simple printer in the virtual machine 305 in the PC 300, so that the simple 
1 5 printer is executed in step S3 7. 

The simple printer operates the compound machine 100 by using the Java JAVA core 
class 304 and the client compound machine class 303. In the operation of the compound 
machine 100, for example, the simple printer 301 sends a message to the server compound 
machine application 210 in the compound machine 100, so that the server compound machine 
20 application 210 operates objects in the feva JAVA execution environment in the compound 
machine 100 so as to operate the compound machine 100. 

As mentioned before, the simple printer 301 initially displays the graphical interface 
screen. Whether displaying the screen on the PC 300 or on the operation panel of the 
compound machine 1 00 can be selected. For example, after the user selects the simple 
25 printer, the remote application management part 302 displays a screen for selecting whether 
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displaying the screen on the PC 300 or on the operation panel of the compound machine 100, 
so that the selection is realized. In this embodiment, the PC 300 is selected and a screen that 
is an emulation screen of the operation panel is displayed on the PC 300. 

Next, the user selects, from the screen of the PC 300, a name of a file to be printed. 
5 The user can selects one among the hard disk of the PC 300 and the hard disk of the 

compound machine 100 as a storage of the file that the user wants to print. Since the user can 
selects the hard disk of the compound machine 100, the user can perform operations on the 
PC 300 as if to operate the compound machine 100 on the operation panel. The selection can 
be performed by displaying a screen for selecting between the hard disks when the simple 
1 0 printer is selected by the remote application management part 302. 

When the hard disk of the compound machine 100 is selected, the user specifies a file 
to print as "/hdd/ts/photo.tiff ' for example from the screen of the PC 300. As a result, the file 
in the hard disk of the compound machine 100 is selected so that the file is printed. 

For ending the operation of the compound machine 1 00, the remote application 
1 5 management part 302 requests the application management part 204 of the compound 

machine 1 00 to end or pause the application, and ends communications with the compound 
machine 100. 

Like the second embodiment, also in the third embodiment, the Java JAVA application 
can be automatically updated by using the JNLP file. 

20 

(Fourth embodiment) 

In the following, another example regarding the remote operation of the third 
embodiment is described as the fourth embodiment. In the fourth embodiment, the 
compound machine 100 is configured as shown in Fig. 16. In the compound machine 100 in 
25 Fig. 16, the Jav aJAVA execution environment 116 and the fevaJAVA application 1 17 are 
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changed to a JSDK application 147 and a JSDK platform 148. The JSDK platform 148 is for 
performing mediation with other software and application management and the like. 

"SDK" means a specific software development kit, and an application developed by 
using the SDK is called "SDK application". As a specific SDK, for example, "JSDK" is 
5 provided for developing an application by using fava JAVA language. An application 
developed by using the JSDK is called "JSDK application". 

Fig. 17 shows classes of the JSDK application 147 and the JSDK platform 148 in 
Fig. 16. The JSDK application 147 and the JSDK platform 148 are compiled from source 
code to byte code by a Java JAVA compiler, and are executed by a jteva JAVA virtual machine 
10 step by step. The JSDK application 147 and the JSDK platform 148 are based on Personal 
Basis Profile of JavaJAVA 2 Micro Edition. 

The JSDK application 147 includes a user application 501, a JSDK GUI Manager 
511, and a Task Bar Manager 512. 

The user application 501 is a JSDK application developed by using the JSDK by a 
1 5 user (a software vender, for example) of the compound machine 100. The JSDK GUI 
Manager 51 1 is a JSDK application for displaying operation screens for operating JSDK 
applications. The Task Bar Manager 5 12 is a JSDK application for displaying task bars for 
operating JSDK applications. 

The user application 501 is "Xlet" that is a Java JAVA application. Each of the JSDK 
20 GUI Manager 511 and the Task Bar Manager 512 is "Xlet (XletEx)" that is extended from 
the Xlet. 

The JSDK platform 148 includes classes such as a JSDK Main 521, a JSDK 
Environment 522, a Locale Manager 523, a Xlet Manager 531, a Multi Xlet Manager 532, a 
JSDK Manager 533, a Send Manager 541, an Event Manager 542, a System Event Manager 
25 543, a Panel Manager 544, an Install Manager 545, a Server/Client Manager546 and the like. 
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The JSDK Main 521 is a class for launching the JSDK Environment 522. The JSDK 
Environment 522 is a class for performing launch environment setting for the JSDK system. 
The Locale Manager 523 is a class for performing foreign language supporting and the like. 

The Xlet Manager 531 is a class for managing life cycle of the Xlet The life cycle of 
5 the five Xlets are managed by five Xlet Managers. The five Xlets are in a one-to-one 

correspondence with the five Xlet Managers. All of the life cycle of the all Xlet managers are 
managed by the Multi Xlet Manager 532. The JSDK Manager 533 is a class for managing 
the life cycle of the whole of the JSDK system. For example, the life cycles of the Multi Xlet 
Manager 532, the Send Manager 541, the Event Manager 542, the System Event Manager 
10 543, the Panel Manager 544, the Install Manager 545 and the Server/Client Manager 546 are 
managed by the JSDK Manager 533. The life cycle of the Xlet is state transitions, for 
example, initialization state (Loaded), paused state (Paused), active state (Active), end state 
(Destroyed) and the like. 

The System Event Manager 543 is a class for managing system events (such as power 
1 5 mode) from the platform 1 20. The Panel Manager 544 is a class for performing mediation 
and the like when one Xlet occupies the screen of the operation panel. The Install Manager 
545 is a class for managing install or uninstall of applications from the SD card and the Web 
server. 

The JSDK system of Fig. 17 includes JSDK API 551 and JSDK API 552. The 
20 difference between the Xlet and the XletEx is that the XletEx can use the JSDK API 551 for 
accessing objects and can access the JSDK platform. The compound machine 100 of Fig. 16 
further includes a JSDK Session 553 and a Native JSDK Session 554 that are interfaces 
between C language and Java JAVA language. The compound machine 100 of Fig. 16 further 
includes a CVM 555 that is a JavaJ AVA virtual machine. 
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As shown in Fig. 18, the compound machine 100 is connected to a PC 701. The PC 
701 functions as an emulator of the compound machine 100. 

The PC 701 in Fig. 18 includes, for example, a keyboard 712, a mouse 713, a display 
714 and the like. The body 71 1 includes a CPU, a ROM, a RAM, a NVRAM, a HDD, a 
5 MODEM, and a NIC and the like. 

The keyboard 712 and the mouse 713 are hardware (operation part) used by an 
operator for inputting data. The display 714 is hardware (display part) for outputting data. 

Fig. 19 shows classes of the JSDK application 147 and the JSDK platform 148 in the 
PC 701 in Fig.18. The PC 701 of Fig.19 includes the JSDK application 147 and the JSDK 
10 platform 148 same as those shown in Fig. 16. 

The differences between Fig. 17 and Fig.19 are as follows. 

First, the Panel Manager 544 in Fig. 17 is replaced by a Panel Manager Emulator 744 
in Fig. 1 9. Second, the JSDK Session 553 in Fig. 1 7 is replaced by the Emulator JSDK 
Session 753 in Fig.19. Third, the Native JSDK Session 554 of Fig. 17 is replaced by an Event 
1 5 Emulator 754 in Fig. 19. Fourth, the CVM 555 of Fig. 1 7 is replaced by the JVM 755 of 
Fig.19. 

The Panel Manager Emulator 744 is a class for emulating the Panel Manager 544 to 
change operations of the operation panel to operations of the keyboard 712 and the mouse 
713. The Emulator JSDK Session 753 is a class for establishing communication routes. The 
20 Event Emulator 754 is a class for emulating operations of the compound machine 100. The 
JVM 755 is a Java JAVA virtual machine for executing the JSDK application 147 and the 
JSDK platform 148. 

Fig.20 is a figure for explaining execution procedure of preparation processes for 
remote operation in the compound machine 100. 
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First, a communication session is established between the Server/Client Manager 546 

in the compound machine 100 and the Server/Client Manager 546 in the PC 701 (1). The 

establishment of the session is performed by a protocol similar to SIP (Session Initiation 

Protocol). 

5 Next, the Server/Client Manager 546 in the compound machine 100 asks the JSDK 

Manager 533 in the compound machine 100 whether the compound machine 100 can change 
to the remote operation mode, so as to determine whether the remote operation can be 
performed (2). 

When the remote operation can be performed, the Server/Client Manager 546 in the 

1 0 compound machine 1 00 sends a request message necessary for remote operation to the PC 
701 via the Send Manager 541 (3), and receives a response message necessary for remote 
operation from the PC 701 via the Event Manager 542 in the compound machine 100 (4). 

Next, the Server/Client Manager 546 in the compound machine 100 requests the 
Panel Manager 544 to send information for remote operation to the PC 701 (5). 

1 5 Finally, between the Server/Client Manager 546 in the compound machine 1 00 and 

the Server/Client Manager 546 in the PC 701, notifications are exchanged for notifying each 
other of completion of preparation of remote operation (6). Accordingly, the remote 
operation from the PC 701 to the compound machine 100 can be performed. Functions for 
realizing distribution processes of applications described in the third embodiment can be 

20 included, for example, in the Server/Client Manager 546 in the compound machine 100 and 
the Server/Client Manager 546 in the PC 701. 

Each program described in the first to fourth embodiments can be stored in a 
recording medium such as a memory card. From the recording medium, the program can be 
installed in the compound machine 100. In addition, a program for constituting the 

25 teva JAVA execution environment such as the virtual machine can be also stored in a 
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recording medium such as a CD-ROM, and can be installed in the PC 300 from the CD- 
ROM. 

As mentioned above, according to the present invention, by providing a Jav aJAVA 
execution environment in the compound machine 1 00, the Java JAVA application can be 
easily installed and launched on the compound machine 100. Therefore, the teva JAVA 
application can be easily executed. In addition, the compound machine 1 00 can be operated 
by executing a J-avaJAVA application in a terminal apparatus connected to the compound 
machine 100 via a network. 

The present invention is not limited to the specifically disclosed embodiments, and 
variations and modifications may be made without departing from the scope of the present 
invention. 

The present application contains subject matter related to Japanese patent application 
No.2003-082908, filed in the JPO on March 25, 2003, and Japanese patent application 
No.2004-078979, filed in the JPO on March 18, 2004, the entire contents of which being 
incorporated herein by reference. 
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ABSTRACT OF THE DISCLOSURE 

An image forming apparatus that includes a control part that provides common 
services on control of hardware resources to a plurality of applications so as to be able to 
include a plurality of applications is provided. The image forming apparatus includes a 
virtual machine; an application that is executed by the virtual machine; and an application 
management part managing the application that is executed by the virtual machine. 
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